A Coronavirus Disease 2019 Pandemic Pivot: Development of the American Board of Anesthesiology's Virtual APPLIED Examination.

In 2020, the coronavirus disease 2019 (COVID-19) pandemic interrupted the administration of the APPLIED Examination, the final part of the American Board of Anesthesiology (ABA) staged examination system for initial certification. In response, the ABA developed, piloted, and implemented an Internet-based "virtual" form of the examination to allow administration of both components of the APPLIED Exam (Standardized Oral Examination and Objective Structured Clinical Examination) when it was impractical and unsafe for candidates and examiners to travel and have in-person interactions. This article describes the development of the ABA virtual APPLIED Examination, including its rationale, examination format, technology infrastructure, candidate communication, and examiner training. Although the logistics are formidable, we report a methodology for successfully introducing a large-scale, high-stakes, 2-element, remote examination that replicates previously validated assessments.

A proposed model for a comprehensive virtual subinternship in vascular surgery.

OBJECTIVE: In the present study, we sought to understand the challenges, advantages, and applications of a vascular surgery virtual subinternship (VSI) curriculum. METHODS: Our institution hosted 25 students for two 4-week VSI rotations, one in July 2020 and one in August 2020. The students participated in a curriculum centered around the use of Zoom and telephone interactions with residents and faculty. The curriculum included selected readings, surgical videos, group didactics, and one-on-one mentorship. Anonymous pre- and postrotation self-assessments were used to ascertain the students' achievement of the learning objectives and the utility of the educational tools implemented during the rotation. The faculty and resident mentors were also surveyed to assess their experience. RESULTS: With the exception of knot-tying techniques (P = .67), the students reported significant improvement in their understanding of vascular surgery concepts after the virtual elective (P < .05). The highest ranked components of the course were interpersonal, including interaction with faculty, mentorship, and learning the program culture. The lowest ranked components of the course were simulation training and research opportunities. The rating of the utility of aspects of the course were consistent with the ranking of the components, with faculty interaction receiving the highest average rating. The ideal amount of time for daily virtual interaction reported by the students ranged from 3 to 6 hours (median, 4 hours). Overall, most of the mentors were satisfied with the virtual course. However, they reported limited ability to assess the students' personality and fit for the program. The time spent per week by the mentors on the virtual vascular surgery rotation ranged from 2 to 7 hours (median, 4 hours). Of the 17 mentors completing the surveys, 14 reported that having a virtual student was a significant addition to their existing workload. CONCLUSIONS: Overall, our student and mentor feedback was positive. Several challenges inherent to the virtual environment still require refinement. However, the goals of a VSI are distinct and should be explored by training programs. With changes to healthcare in the United States on the horizon and the constraints resulting from the severe acute respiratory syndrome coronavirus 2 pandemic, implementing a virtual away rotation could be an acceptable platform in our adaptations of our recruitment strategies.

Quality Improvement Amid a Global Pandemic: A Virtual Curriculum for Medical Students in the Time of COVID-19.

Introduction: The COVID-19 pandemic in March of 2020 necessitated the removal of medical students from direct patient care activities to prevent disease spread and to conserve personal protective equipment. In order for medical student education to continue, virtual and online electives were designed and implemented expeditiously. We created a virtual curriculum that taught quality improvement (QI) skills within the context of the global pandemic. Methods: This 4-week curriculum enrolled 16 students. Students completed the revised QI knowledge application tool (QIKAT-R) before and after the course to assess QI knowledge. Students completed prereading, online modules, and received lectures on QI and incident command systems. Each group designed their own QI project related to our hospital system's response to the pandemic. Finally, groups presented their projects at a peer symposium and completed peer evaluations. Results: Students' QIKAT-R scores improved throughout the course from a mean of 5.5 (SD = 1.3) to a mean of 7.5 (SD = 1.1; p < 0.001). Students reported that the virtual learning experience delivered the material effectively, and all students agreed that they would participate in QI work in the future. Discussion: Patient safety and QI topics are content areas for multiple medical licensing examinations. Virtual learning is an effective way to deliver QI content to medical students and residents, especially when projects are trainee-led, QI-trained faculty serve as mentors, and the projects harmonize with institutional goals. Our virtual pandemic-focused curriculum has demonstrated efficacy in increasing medical student QI knowledge.

DeepLMS: a deep learning predictive model for supporting online learning in the Covid-19 era.

Coronavirus (Covid-19) pandemic has imposed a complete shut-down of face-to-face teaching to universities and schools, forcing a crash course for online learning plans and technology for students and faculty. In the midst of this unprecedented crisis, video conferencing platforms (e.g., Zoom, WebEx, MS Teams) and learning management systems (LMSs), like Moodle, Blackboard and Google Classroom, are being adopted and heavily used as online learning environments (OLEs). However, as such media solely provide the platform for e-interaction, effective methods that can be used to predict the learner's behavior in the OLEs, which should be available as supportive tools to educators and metacognitive triggers to learners. Here we show, for the first time, that Deep Learning techniques can be used to handle LMS users' interaction data and form a novel predictive model, namely DeepLMS, that can forecast the quality of interaction (QoI) with LMS. Using Long Short-Term Memory (LSTM) networks, DeepLMS results in average testing Root Mean Square Error (RMSE) [Formula: see text], and average correlation coefficient between ground truth and predicted QoI values [Formula: see text] [Formula: see text], when tested on QoI data from one database pre- and two ones during-Covid-19 pandemic. DeepLMS personalized QoI forecasting scaffolds user's online learning engagement and provides educators with an evaluation path, additionally to the content-related assessment, enriching the overall view on the learners' motivation and participation in the learning process.

Interactive pedagogical tools could be helpful for medical education continuity during COVID-19 outbreak.

Training and education are essential for medical students. During the COVID-19 outbreak, numerous schools and universities have had to close. Ensuring pedagogical continuity requires alternatives to the traditional classroom, especially in medical education. Usual distance learning tools such as videos and downloadable handouts are not sufficient to promote efficient teaching. Distance learning requires self-motivation and does not give you direct access to your instructor. Some students fear the loss of human contact with an instructor - like asking questions during and after class - which promotes learning, understanding and communication. Moreover, classical distance learning methods do not offer immediate feedback that can help students in their understanding of the lecture. In this context, interactive pedagogic tools (IPT) could be useful for medical education continuity and for maintaining human contact necessary in pedagogy. We briefly evaluated interactive pedagogic tool compared to traditionnal distancial tools on medical students. This study showed the importance to have direct contact with a teacher and feedback during a lecture and to not exclusively perform distance learning without direct interaction and feedback. Hence, in the present context, we encourage teacher to use this type of tools to maintain direct interaction with students - which is essential in pedagogy - and ensure a qualitative pedagogical continuity.